Display device, and method of controlling display device

ABSTRACT

A projector includes an image generation section adapted to generate a composite image including a first image based on a first image signal, a second image based on a second image signal, and a boundary line indicating a position to be a boundary between the first image and the second image, a projection section adapted to display the composite image generated by the image generation section on a screen, a position detection section adapted to detect a position of a pointing body with respect to the screen, and a control section adapted to make the image generation section generate a composite image with a boundary line moved based on the position of the pointing body detected by the position detection section.

CROSS-REFERENCE

This application is a continuation of U.S. patent application Ser. No.16/360,625, filed on Mar. 21, 2019, which is a continuation of U.S.patent application Ser. No. 15/668,011, filed on Aug. 3, 2017, whichclaims the benefit of Japanese Patent Application No. 2016-158444, filedon Aug. 12, 2016. Each of the above identified documents is herebyincorporated by reference in entirety.

BACKGROUND 1. Technical Field

The present invention relates to a display device and a method ofcontrolling the display device.

2. Related Art

In the past, there has been known a projector, which modulates a lightbeam emitted from a light source to thereby form an image correspondingto image information, and project the image thus formed on a screen inan enlarged manner.

In recent years, as shown in JP-A-2004-54134, there is disclosed aprojector, which receives image signals from a plurality of inputsources to project a plurality of images corresponding to the pluralityof image signals on a screen.

In the case of attempting to display an image, which the user focusesattention on out of the plurality of images projected by such aprojector, on the screen so as to be larger in size than other images,the user sets the priority having been set to the image, on which theuser focuses attention, to be higher than the priority of other images.Thus, the projector displays the image, on which the user focusesattention, so as to be larger in size than other images in accordancewith the priorities and the numbers of the pixels of the images.

However, in the projector described above, although it is possible todisplay the image so as to be larger in size by raising the priority,since the size of the image to be displayed is determined in accordancewith the priority and the number of pixels, it is unachievable for theuser to explicitly designate the size of the image to be projected onthe screen.

SUMMARY

An advantage of some aspects of the invention is to designate thedesired size of an image to be projected in the case of projecting aplurality of images.

The invention can be implemented as the following forms or applicationexamples.

APPLICATION EXAMPLE 1

A display device according to this application example includes an imagegeneration section adapted to generate a composite image including afirst image based on a first image signal, a second image based on asecond image signal, and a boundary line indicating a position to be aboundary between the first image and the second image, a display sectionadapted to display the composite image generated by the image generationsection on a display surface, a detection section adapted to detect aposition of a pointing body with respect to the display surface, and acontrol section adapted to make the image generation section generatethe composite image with the boundary line moved based on the positionof the pointing body detected by the detection section.

According to such a configuration, by moving the pointing body in thedisplay surface on which the composite image including the first imagebased on the first image signal, the second image based on the secondimage signal and the boundary line indicating the position to be theboundary between the first image and the second image is projected, thecomposite image with the boundary line moved is generated and thenprojected. Therefore, the sizes of the first image and the second imagecan explicitly be designated by the move of the pointing body.

APPLICATION EXAMPLE 2

In the display device according to the application example describedabove, it is preferable for the control section to make the imagegeneration section generate the composite image added with an indicationline at a division position the closest to the boundary line out of aplurality of division positions where the first image and the secondimage can be separated from each other in the composite image.

According to such a configuration, since the indication line isdisplayed at the position closest to the position of the pointing bodyout of the division positions where the first image and the second imagecan be separated from each other, it is possible to visually recognizethe position where the two images can be separated with the sizesapproximate to the desired sizes.

APPLICATION EXAMPLE 3

In the display device according to the application example describedabove, it is preferable that in a case in which the control sectionmakes the image generation section generate the composite image having apointing area, which can be pointed by the pointing body, superimposedon the boundary, and then detect that the pointing area of the compositeimage displayed on the display surface is clicked by the pointing body,the control section makes the image generation section move the boundaryline of the composite image to a first division position adjacent to theboundary out of the plurality of division positions.

According to such a configuration, by clicking the pointing areadisplayed so as to be superimposed on the boundary, it is possible tomove the boundary line to the first division position adjacent to thedivision position corresponding to the indication line.

APPLICATION EXAMPLE 4

In the display device according to the application example describedabove, it is preferable for the pointing area to be able to be movedalong the boundary line.

According to such a configuration, since the pointing area can be movedalong the indication line, it is possible to move the pointing area to aposition where the visibility does not degrade in accordance with theimage projected.

APPLICATION EXAMPLE 5

In the display device according to the application example describedabove, it is preferable that in a case in which the first image signalis input from a first input source, the display section displays thefirst image on the display surface, and does not display the secondimage on the display surface, if the control section detects that theboundary line moves to a position other than an end part, the controlsection makes the image generation section generate the composite image,which includes the second image based on the second image signal inputfrom the second input source different from the first input source,based on the boundary line moved.

According to such a configuration, in the case in which the displaysection displays the first image, but does not display the second image,the composite image further including the second image based on thesecond input source is generated based on the position of the boundarythus moved. Therefore, it is possible to generate the composite imageobtained by combining the images based on the plurality of input sourcesbased on the position of the indication line.

APPLICATION EXAMPLE 6

In the display device according to the application example describedabove, it is preferable for the control section to perform a signaldiscrimination process on the second image signal without performing thesignal discrimination process on the first image signal.

According to such a configuration, since the signal discriminationprocess is not performed on the first image signal, the first imagegenerated based on the first image signal can be displayed withoutregenerating the first image.

APPLICATION EXAMPLE 7

In the display device according to the application example describedabove, it is preferable that in a case in which the second input sourcecan be selected from a plurality of sources including a first source anda second source, the control section makes the image generation sectiongenerate the composite image provided with a first pointing areacorresponding to the first source and a second pointing area differentfrom the first pointing area and corresponding to the second source.

According to such a configuration, it becomes easy to select the inputsource.

APPLICATION EXAMPLE 8

In the display device according to the application example describedabove, it is preferable that in a case of disposing the second image inan area of the composite image where the first image has been disposedbased on the boundary, the control section determines an area of thefirst image displayed in priority based on the information having beenset.

According to such a configuration, in the case of disposing the secondimage in a partial area of the composite image where the first image hasbeen disposed, there area of the first image to be displayed in prioritycan be set.

APPLICATION EXAMPLE 9

A method of controlling a display device according to this applicationexample includes generating a composite image including a first imagebased on a first image signal, a second image based on a second imagesignal, and a boundary line indicating a position to be a boundarybetween the first image and the second image, displaying the compositeimage having been generated on a display surface, detecting a position apointing body with respect to the display surface, and generating thecomposite image with the boundary line moved based on the position ofthe pointing body having been detected.

According to such a method, by moving the pointing body in the displaysurface on which the composite image including the first image based onthe first image signal, the second image based on the second imagesignal and the boundary line indicating the position to be the boundarybetween the first image and the second image is projected, the compositeimage with the boundary line moved is generated and then projected.Therefore, the sizes of the first image and the second image canexplicitly be designated by the move of the pointing body.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be described with reference to the accompanyingdrawings, wherein like numbers reference like elements.

FIG. 1 is a diagram showing a usage example of a projector according toan embodiment of the invention.

FIG. 2 is a functional block diagram showing a configuration of theprojector according to the embodiment.

FIG. 3 is a flowchart showing the flow of a process of dual-partitioningdisplay.

FIG. 4 is a flowchart showing the flow of a drag process of a two-screenbutton.

FIG. 5 is a flowchart showing the flow of the process ofdual-partitioning display.

FIG. 6 is a diagram showing positions of a plurality of indicationlines.

FIG. 7A is a diagram showing a first projection screen due to anexternal input mode.

FIG. 7B is a diagram showing move of a guide line in the firstprojection screen due to the external input mode.

FIG. 7C is a diagram showing move of the guide line in the firstprojection screen due to the external input mode.

FIG. 7D is a diagram showing move of the guide line in the firstprojection screen due to the external input mode.

FIG. 7E is a diagram showing move of a guide line in the firstprojection screen due to the external input mode.

FIG. 7F is a diagram showing move of a guide line in the firstprojection screen due to the external input mode.

FIG. 8A is a diagram showing an example of performing thedual-partitioning display with a size of left-expansion.

FIG. 8B is a diagram showing an example of performing thedual-partitioning display with the same size.

FIG. 8C is a diagram showing an example of performing thedual-partitioning display with a size of right-expansion.

FIG. 8D is a diagram showing an example of performing projection with asingle screen.

FIG. 9A is a diagram showing move of the guide line from a state ofperforming the dual-partitioning display.

FIG. 9B is a diagram showing move of the guide line from the state ofperforming the dual-partitioning display.

FIG. 9C is a diagram showing move of the guide line from the state ofperforming the dual-partitioning display.

FIG. 10 is a flowchart showing the flow of a process of determining thesources displayed in the case of performing the dual-partitioningdisplay.

FIG. 11 is a diagram for explaining the direction of displaying a secondprojection screen.

FIG. 12 is a diagram showing the first projection screen on which aplurality of pointing areas is displayed.

DESCRIPTION OF AN EXEMPLARY EMBODIMENT

An embodiment of the invention will hereinafter be described withreference to the accompanying drawings.

EMBODIMENT

FIG. 1 is a diagram showing a usage example of a projector 10 accordingto an embodiment to which the invention is applied. The projector 10 isone of display devices, and is of a short-focus type dispose immediatelyabove the screen SC as a display surface, and for projecting an imageobliquely downward. Further, the screen SC illustrated in the presentembodiment is a flat plate or a curtain fixed to a wall surface, orerected on the floor surface. It should be noted that it is alsopossible to use the wall surface as the screen SC. In this case, it isalso possible to attach the projector 10 to an upper part of the wallsurface used as the screen SC.

The projector 10 is capable of projecting an image on the screen SCbased on image data input from the outside as an external input mode.

Further, the projector 10 has a function (an interactive function) for auser (an operator) to instruct a predetermined operation using apointing body 70 on the screen SC for projecting the image. The pointingbody 70 is, for example, a pen-shaped input device, and the operatoruses the input device while gripping a shaft part 71 so as to press thetip of the input device against the screen SC. The tip of the pointingbody 70 is provided with an operation switch 72 for detecting thepressing operation, and in the case in which the operator presses thetip of the pointing body 70 against the screen SC, the operation switch72 is set to the ON state. By pressing the tip of the pointing body 70against the screen SC at an arbitrary position on the screen SC, it ispossible for the operator to perform a position pointing operation.

As described later, the projector 10 is provided with a function ofdetecting the position of the pointing body 70 on the screen SC. It ispossible for the projector 10 to detect the position where the tip ofthe pointing body 70 has contact with the screen SC as the operationposition in the case in which the operator performs the positionpointing operation, and then receive the position pointing operationperformed by the operator with the pointing body 70 to reflect thisoperation on the projection image. Specifically, the projector 10 drawsa drawing image 200 of a figure such as a straight line, a curved line,or a polygon, or a character based on a drawing operation by the user,namely an operation of the pointing body 70 held by the user moving inthe state of being pressed against the screen SC, and then projects thedrawing image 200 on the screen SC.

For example, the projector 10 has a function (a whiteboard (WB)function) of projecting a second projection image 220 on the screen SCwith white light to make a state like a whiteboard, and at the same timedrawing the drawing image 200 on the screen SC in the case in which noimage is projected on the screen SC as shown in FIG. 1. Theconfiguration of performing such a WB function is called a WB mode.

Further, the projector 10 has a function (an annotation function)capable of drawing the drawing image 200 superimposed on the projectionimage in the case in which some projection images are projected on thescreen SC.

Further, as described later, in the case in which a two-screen button230 projected on the screen SC is pointed by the pointing body 70, theprojector 10 is capable of dividing the area projected on the screen SCinto two, and projecting images of respective modes different from eachother, e.g., the WB mode and an external input mode, in the respectiveareas thus divided at the same time.

Further, the projector 10 is capable of storing the image drawn on thescreen SC as image data. In this case, it is possible to store only thedrawing image 200 as the image data, or it is also possible to store animage obtained by superimposing the projection image, which has beenprojected on the screen SC at the time of drawing, and the drawing image200 on each other as the image data.

The projector 10 is provided with an operation panel 19 disposed on anexterior housing. The operation panel 19 has a variety of switches andindicator lamps, and the indicator lamps light or blink in accordancewith the operation state and the setting state of the projector 10.

FIG. 2 is a functional block diagram of sections constituting theprojector 10.

The projector 10 is provided with an image data input section 12 towhich the image data is input.

The image data input section 12 can also be, for example, a USBinterface, or a communication interface such as wired or wireless LANinterface. For example, it is also possible for a computer system orother projectors as an input source to be connected via a LAN interfaceprovided to the image data input section 12.

It is also possible for the image data input section 12 to be providedwith an input terminal to which an analog video signal or a digitalvideo signal is input. The input terminal is a VGA terminal, a DVI(Digital Visual Interface), an S-video terminal, an RCA terminal, aD-terminal, an HDMI connector compliant with the HDMI (registeredtrademark) standard or the like. It is also possible for the image datainput section 12 to be provided with an interface circuit or an imageprocessing circuit corresponding to such an input terminal.

Further, the image data input section 12 can also be provided with areading function of reading the image data stored in a flash memory orthe like. The image signal (a first image signal) input to the imagedata input section 12 is transmitted to an image processing section 30via a input signal switching section 14.

Further, the projector 10 is provided with a position detection section20 for detecting the position of the pointing body 70 relatively to thescreen SC. The position detection section (detection section) 20 isconfigured including an imaging section 26, a pointing body detectionsection 24, and a coordinate calculation section 22.

The imaging section 26 has an imaging optical system, an imagingelement, an interface circuit, and so on, and shoots the projectiondirection of the projection optical system 96. The imaging opticalsystem of the imaging section 26 is disposed so as to face to the samedirection as the projection optical system 96, and has a field angle ofcovering the range in which the projection optical system 96 projectsthe image on the screen SC. Further, as the imaging element, there canbe cited CCD and CMOS. The interface circuit reads out and then outputsthe detection value of the imaging element.

The imaging section 26 shoots the pointing body 70 operated on thescreen SC or in the vicinity of the screen SC together with the imageprojected on the screen SC. The imaging element of the imaging section26 can be one having sensitivity in a wavelength band of the visiblelight, or can also have sensitivity in a wavelength band of the infraredlight or a wavelength band of the infrared light and the visible light.In the present embodiment, the imaging section 26 outputs shot imagedata of the infrared light.

The pointing body detection section 24 detects the position of thepointing body 70 based on the shot image data output by the imagingsection 26. The pointing body detection section 24 performs a process ofdetecting a shape similar to the pointing body 70 from the shot imagedata to cut out the image of the pointing body 70, and then identifiesthe position of the pointing body 70 in the shot image data. Here, it isalso possible for the pointing body detection section 24 to identify thedirection to which the tip of the pointing body 70 faces. It should benoted that the detection method of the pointing body 70 is not limitedto the method of detecting the shape similar to the pointing body 70,but it is also possible to assume a detection method of the reflectedlight due to a light curtain.

It is possible for the detection method of the reflected light by thelight curtain to, for example, emit detection light (e.g., infraredlight) having a layered shape (or a curtain shape) throughout the entiresurface of the screen SC, then shoot the reflected light reflected bythe pointing body 70 having a region reflecting the infrared light, andthen detect the position of the pointing body 70 based on the positionof the reflected light in the shot image. The details of the detectionmethod of the reflected light due to the light curtain are not anessential part of the invention, and are therefore omitted (regardingthis method, see, e.g., JP-A-2015-159523).

The coordinate calculation section 22 calculates the coordinate of theposition pointed by the tip of the pointing body 70 on the screen SC,namely the coordinate of the operation position, based on the positionof the pointing body 70 in the shot image data identified by thepointing body detection section 24. Specifically, the coordinatecalculation section calculates the coordinate with reference to the area(projection area) in which a projection section 90 projects the image onthe screen SC based on the operation position in the shot image data.The coordinate calculation section 22 outputs the data representing thecoordinate of the operation position this calculated, the operationstate of the operation switch 72, and so on to the WB function section16, the annotation drawing section 40, and a control section 80.

The WB function section 16 projects the white light on the screen SClike a so-called whiteboard in the WB mode, and at the same time,generates the drawing image 200 on the screen SC based on the moveoperation of the pointing body 70. In the present embodiment, as the WBfunction section 16, there is assumed a configuration in which thehardware and the software for realizing the function are independent inthe projector 10. The image signal (the second image signal) of thedrawing image 200 generated by the WB function section 16 is transmittedto the image processing section 30 via the input signal switchingsection 14.

The input signal switching section 14 switches the input source of theimage signal to be processed by the image processing section 30 based onan instruction of the control section 80. In the present embodiment, theinput signal switching section 14 selects the image data from the imagesignal generated by the WB function section 16 and the image signalsinput to the image data input section 12 based on an instruction of thecontrol section 80, and then transmits the image data thus selected tothe image processing section 30.

The projector 10 can generally be divided into the projection section 90for forming an optical image, and an image processing system forprocessing the image data.

The projection section 90 is configured including an illuminationoptical system 92, a light modulation device 94, and a projectionoptical system 96. The projection section 90 corresponds to a displaysection for displaying an image on a display surface.

The illumination optical system 92 is provided with a light sourceformed of a xenon lamp, a super-high pressure mercury lamp, a lightemitting diode (LED), a laser source, or the like. Further, theillumination optical system 92 can also be provided with a reflector andan auxiliary reflector for guiding the light emitted by the light sourceto the light modulation device 94. Further, there can also be provided alens group (not shown) for enhancing the optical characteristics of theprojection light, a polarization plate, a dimming element for reducingthe light intensity of the light emitted by the light source on a pathleading to the light modulation device 94, and so on.

The light modulation device 94 is provided with, for example, threetransmissive liquid crystal panels corresponding respectively to thethree primary colors of RGB, and modulates the light transmitted throughthe liquid crystal panels to thereby generate the image light. The lightfrom the illumination optical system 92 is separated into colored lightbeams of three colors of RGB, and the colored light beams enter thecorresponding liquid crystal panels, respectively. The colored lightbeams, which have been modulated while passing through the respectiveliquid crystal panels, are combined by a combining optical system suchas a cross dichroic prism, and are then output to the projection opticalsystem 96.

The projection optical system 96 is provided with, for example, a zoomlens for performing expansion and contraction of the image to beprojected and adjustment of the focus, a zoom controlling motor forcontrolling the level of the zoom, a focus adjusting motor forperforming the focus adjustment, and a concave mirror for reflecting theprojection light toward the screen SC. The projection optical system 96performs the zoom adjustment and the focus adjustment of the image lighthaving been modulated by the light modulation device 94, then guides thelight having passed through the zoom lens toward the screen SC with theconcave mirror, and then focus the light on the screen SC. To theprojection section 90, there are connected a projection optical systemdrive section 64 for driving the respective motors provided to theprojection optical system 96 in accordance with the control of thecontrol section 80, and a light source drive section 66 for driving thelight source provided to the illumination optical system. 92 inaccordance with the control of the control section 80. It should benoted that the specific configuration of the projection optical system96 is not limited to the example described above, and it is alsopossible to project and then focus the light, which has been modulatedby the light modulation device 94, on the screen SC by a lens using aconfiguration without using a mirror including the concave mirror.

On the other hand, the image processing system is provided with astorage section 85, an operation detection section 18, the imageprocessing section 30, the annotation drawing section 40, a GUIgeneration section 50, a picture combining section 60, and a lightmodulation device drive section 62 centered on the control section 80for controlling the whole of the projector 10.

The storage section 85 stores a control program executed by the controlsection 80 and data processed by the functional sections such as thecontrol section 80.

The operation detection section 18 detects the operation instructiontransmitted from the operation panel 19 or a remote controller (notshown), and then transmits the information of the operation instructionthus detected to the control section 80.

The image processing section 30 processes the image signal generated bythe WB function transmitted via the input signal switching section 14and the image signals input to the image data input section 12.

The image processing section 30 arbitrarily performs a variety ofconversion processes such as an interlace/progressive conversion, aresolution conversion, and a color conversion on the image signal input,then generates the image data having a predetermined format, and thendevelops the image in the frame memory 35 frame by frame. The image datadeveloped in the frame memory 35 is output to the picture combiningsection 60.

The annotation drawing section 40 has a function of drawing an imageobject, which has been drawn by the pointing body 70, so as to besuperimposed on the image based on the image data input. For example, inthe case in which the computer system is the input source (a first inputsource), the annotation drawing section 40 draws a line, a figure(annotation) and so on so as to be superimposed on the window displayedby an application program executed by the computer system. The imagedata, to which the image object is added by the annotation drawingsection 40, is output to the picture combining section 60.

The GUI generation section 50 generates a GUI (Graphical User Interface)to be projected on the screen SC. For example, in the case in which theprojector 10 is projecting an image based on the image data suppliedfrom one of the input sources (second input sources) as the WB mode orthe external input mode, the GUI generation section 50 generates thetwo-screen button 230 as a pointing area (the GUI image) with whichdual-partitioning display using a plurality of input sources can bepointed by the pointing body 70. The image data of the two-screen button230 thus generated is output to the picture combining section 60.

The picture combining section 60 generates the image data of a compositeimage obtained by combining the image data transmitted from theannotation drawing section 40 and the image data transmitted from theGUI generation section 50 with each other using the image data of eachframe transmitted from the image processing section 30 as a base. Theimage data thus generated is output to the light modulation device drivesection 62.

The image processing section 30 described above, the annotation drawingsection 40, the GUI generation section 50, and the picture combiningsection 60 correspond to an image generation section for combining aplurality of images with each other to generate the composite image.

It should be noted that it is also possible for the control section 80to perform the keystone distortion correction or the pin-cushiondistortion correction on the image data generated by the picturecombining section 60.

The light modulation device drive section 62 drives the light modulationdevice 94 to perform drawing based on the image data output from thepicture combining section 60.

Then, FIG. 3 through FIG. 5 are flowcharts showing the flow of a process(a control method) of the dual-partitioning display. It should be notedthat in order to make the process of the dual-partitioning display easyto understand, the explanation will be presented arbitrarily referringto FIG. 6, FIG. 7A through FIG. 7F, FIG. 8A through FIG. 8D, and FIG. 9Athrough FIG. 9C.

There is assumed the state that, for example, as shown in FIG. 7A, afirst projection screen 210 including a UI image 215A is projected onthe screen SC, a first two-screen button 230A is included in a left endpart of the first projection screen 210, and a second two-screen button230B is included in a right end part of the first projection screen 210.The first projection screen 210 shown in FIG. 7A is a screen obtained byprojecting the image (the first image) generated based on the imagesignal (the first image signal) output by the computer system as theexternal input mode on the screen SC. Here, the second projection screen220 as the image (the second image) generated based on the image signal(the second image signal) output by the WB function section 16 is notdisplayed.

In such a state, in the case in which the pointing body 70 operated bythe operator clicks the two-screen button 230 (the first two-screenbutton 230A, the second two-screen button 230B) projected on the screenSC, the process of the dual-partitioning display is performed.

If this process is performed, firstly, the control section 80 determines(step S100) whether or not the two-screen button 230 has moved beyond apredetermined distance while being clicked.

Here, in the case in which it has been determined that the two-screenbutton 230 has moved beyond the predetermined distance while beingclicked (Yes in the step S100), a drag process (step S120) of thetwo-screen button 230 is performed, and then the process is terminated.It should be noted that the details of the drag process (step S120) ofthe two-screen button 230 will be described later.

On the other hand, in the case in which it has been determined that thetwo-screen button 230 has not moved beyond the predetermined distancewhile being clicked (No in the step S100), the control section 80determines (step S102) whether or not the two-screen button 230 onceclicked has been released (dropped).

Here, in the case in which it has been determined that the two-screenbutton 230 once clicked has not been released (No in the step S102), theprocess is terminated.

On the other hand, it has been determined that the two-screen button 230once clicked has been released (Yes in the step S102), the controlsection 80 determines (step S104) whether or not two screens areprojected and displayed on the screen SC in the present state.

Here, in the case in which it has been determined that the two screensare projected and displayed on the screen SC in the present state (Yesin the step S104), a releasing process (step S140) during thedual-partitioning display is performed, and then the process isterminated. It should be noted that the details of the releasing process(step S140) during the dual-partitioning display will be describedlater.

On the other hand, in the case in which it has been determined that thetwo screens are not projected on the screen SC in the present state (Noin the step S104), the control section 80 determines (step S106) whetheror not the first two-screen button 230A projected on the left end hasbeen released.

Here, in the case in which it has been determined that the firsttwo-screen button 230A has been released (Yes in the step S106), thecontrol section 80 displays (step S108) the two screens (FIG. 8C) usingan indication line 250D (FIG. 6) assumed in the second one from the leftof a plurality of indication lines 250 as a boundary, and thenterminates the process.

On the other hand, in the case in which it has been determined that thesecond two-screen button 230B has been released (No in the step S106),the control section 80 displays (step S110) the two screens (FIG. 8A)using an indication line 250B (FIG. 6) assumed in the second one fromthe right of the plurality of indication lines 250 as a boundary, andthen terminates the process.

Here, the indication lines 250 will be described with reference to FIG.6.

FIG. 6 is a diagram showing positions of the plurality of indicationlines 250. In the present embodiment, it is assumed that the number ofpixels constituting the screen is 1280 in the horizontal direction and800 in the vertical direction, and there are three division sizes of thetwo screens, namely right-expansion, the same size, and left-expansion,but the sizes of the screens and the number of pixels are not limited.It should be noted that the number of the indication lines 250 is anumber obtained by adding 2 (corresponding to the both ends) to thedivision number.

In the present embodiment, the left end of the screen projected isdefined as the origin, and the position of the right end is defined as1280. Further, the position Mn representing the n-th one (it should benoted that n is a natural number equal to or larger than 1, and in therange of no higher than (division number)+2) from the origin side of theindication lines 250 is expressed as Formula (1). The position Mnrepresents the division positions where the two projection screens canbe separated.

Mn=(horizontal width of the panel)×(n−1)/((division number)+1)  (1)

Therefore, according to Formula (1), the first indication line 250Ecorresponds to the origin. Similarly, the position of the secondindication line 250D is 320, the position of the third indication line250C is 640, the position of the fourth indication line 250B is 960, andthe position of the fifth indication line 250A is 1280.

Further, the switching range R for switching to the adjacent one of theindication lines 250 is expressed as Formula (2).

R=(horizontal width of the panel)×0.5/((division number)+1)   (2)

Therefore, in the present embodiment, the switching range R is 160. Byapplying the switching range R to FIG. 6, branching positions of therespective indication lines 250 are 160, 480, 800, and 1120,respectively.

Further, in the present embodiment, the relationship between theposition PX of the two-screen button 230 and the indication lines 250displayed is as expressed as Formula (3).

(Mn−R)≤PX<(Mn+R)  (3)

Therefore, in the case in which the position PX of the two-screen button230 is within the range expressed by Formula (3), the control section 80displays the n-th one from the origin side of the indication lines 250.

In accordance with the above description, in the step S108, thedual-partitioning display is performed so that the position of thesecond indication line 250D becomes the boundary as shown in FIG. 8C.

The control section 80 generates the UI image 215D based on the size ofthe first projection screen 210 in the external input mode, and thenprojects the UI image 215D thus generated on the screen SC. Further, thecontrol section 80 projects the area, which can be drawn in the WB mode,on the screen SC with the size of the second projection screen 220 and awhite color.

Further, the control section 80 projects a third two-screen button 230Cgenerated by the GUI generation section 50 at the boundary positionbetween the first projection screen 210 and the second projection screen220. It should be noted that the third two-screen button 230C can beclicked and dragged in the horizontal direction with the pointing body70 similarly to the first two-screen button 230A and the secondtwo-screen button 230B. Further, the third two-screen button 230C isgenerated so that whether the part clicked is located on the right sideor the left side of the third two-screen button 230C can be recognized.

Similarly, in the step S110, the dual-partitioning display is performedso that the position of the fourth indication line 250B becomes theboundary as shown in FIG. 8A.

The control section 80 generates the UI image 215B based on the size ofthe first projection screen 210 in the external input mode, and thenprojects the UI image 215B thus generated on the screen SC. Further, thecontrol section 80 projects the area, which can be drawn in the WB mode,on the screen SC with the size of the second projection screen 220 and awhite color.

FIG. 4 is a flowchart showing the flow of the drag process (step S120)of the two-screen button 230.

It should be noted that in the following description, there is assumedthe state in which the pointing body 70 operated by the operator hasdragged the second two-screen button 230B, which has been projected onthe right end of the first projection screen 210 in the state shown inFIG. 7A, to move the second two-screen button 230B beyond thepredetermined distance as shown in FIG. 7B through FIG. 7F.

Firstly, the control section 80 draws (step S122) the guide line 240,which is a boundary line indicating the position defining the boundarybetween the first projection screen 210 and the second projection screen220, in a vertical direction at a central position in the horizontaldirection of the second two-screen button 230B in the first projectionscreen 210.

It should be noted that in the case in which the two-screen button 230is clicked and dragged, the guide line 240 moves following thetwo-screen button 230 which moves. Further, the two-screen button 230can move on the guide line 240 in the vertical direction.

Then, the control section 80 draws (step S124) the indication line 250in accordance with the position of the second two-screen button 230B inmotion. In other words, the control section 80 projects the firstprojection screen 210 added with the indication line 250 at a divisionposition nearest to the position of the guide line 240.

In the case in which the second two-screen button 230B is located at theposition shown in FIG. 7B, therefore, the second two-screen button 230Bis located on the right side of the branching position (1120) betweenthe fourth indication line 250B and the fifth indication line 250A.Therefore, the control section 80 draws the fifth indication line 250A.

Then, the control section 80 determines (step S126) whether or not thesecond two-screen button 230B has been released.

Here, in the case in which the second two-screen button 230B has notbeen released (No in the step S126), the process is terminated. In thiscase, after a predetermined time elapses, the drag process (step S120)of the two-screen button 230 is performed again.

For example, in the case in which the second two-screen button 230Bfurther moves leftward while being clicked, and is then located on theleft side of the branching position (1120) between the fourth indicationline 250B and the fifth indication line 250A as shown in FIG. 7C, thecontrol section 80 draws the fourth indication line 250B instead of thefifth indication line 250A.

Further, in the case in which the second two-screen button 230B furthermoves leftward while being clicked, and is then located on the rightside of the branching position (480) between the second indication line250D and the third indication line 250C as shown in FIG. 7D, the controlsection 80 draws the third indication line 250C.

Further, in the case in which the second two-screen button 230B furthermoves leftward while being clicked, and is then located on the left sideof the branching position (480) between the second indication line 250Dand the third indication line 250C as shown in FIG. 7E, the controlsection 80 draws the second indication line 250D.

Further, in the case in which the second two-screen button 230B furthermoves leftward while being clicked, and is then located on the left sideof the branching position (160) between the first indication line 250Eand the second indication line 250D as shown in FIG. 7F, the controlsection 80 draws the first indication line 250E.

Going back to FIG. 4, in the step S126, in the case in which the secondtwo-screen button 230B is released (Yes in the step S126), the controlsection 80 erases (step S128) the guide line 240 and the indication line250 thus drawn.

Then, the control section 80 determines (step S130) whether or not theposition of the indication line 250 thus erased is either one of theleft end or the right end of the first projection screen 210.

Here, in the case in which the position of the indication line 250 thuserased is either one of the left end and the right end of the firstprojection screen 210 (Yes in the step S130), the control section 80displays (step S134) only the present external input mode in theone-screen display, and then terminates the process.

For example, in the case in which the second two-screen button 230B hasbeen released in the state shown in FIG. 7B, the control section 80projects the first projection screen 210 on the screen SC as shown inFIG. 7A.

Further, in the case in which the second two-screen button 230B has beenreleased in the state shown in FIG. 7F, the control section 80 projectsthe second projection screen 220 on the screen SC as shown in FIG. 8D.

The second projection screen 220 shown in FIG. 8D is a screen obtainedby projecting the image (the second image) generated based on the imagesignal (the second image signal) output by the WB function section 16 onthe screen SC.

It should be noted that in the present embodiment, in the case in whichthe second projection screen 220 is displayed in the one-screen display,a fourth two-screen button 230D is displayed in the left end part, and afifth two-screen button 230E is displayed in the right end part.

On the other hand, in the case in which the position of the indicationline 250 thus erased is neither the left end nor the right end of thefirst projection screen 210 (No in the step S130), the control section80 displays (step S132) the two screens with the size corresponding tothe position of the indication line 250, and then terminates theprocess.

For example, in the case in which the second two-screen button 230B hasbeen released in the state in which the fourth indication line 250B isdisplayed as shown in FIG. 7C, the control section 80 projects the firstprojection screen 210 and the second projection screen 220 on the screenSC dividing the screen SC into two parts so as to achieve theleft-expansion size shown in FIG. 8A.

Further, in the case in which the second two-screen button 230B has beenreleased in the state in which the third indication line 250C isdisplayed as shown in FIG. 7D, the control section 80 projects the firstprojection screen 210 and the second projection screen 220 on the screenSC dividing the screen SC into two parts so as to achieve the same sizeshown in FIG. 8B.

Further, in the case in which the second two-screen button 230B has beenreleased in the state in which the second indication line 250D isdisplayed as shown in FIG. 7E, the control section 80 projects the firstprojection screen 210 and the second projection screen 220 on the screenSC dividing the screen SC into two parts so as to achieve theright-expansion size shown in FIG. 8C.

It should be noted that in the present embodiment, there is describedthe case in which the second two-screen button 230B is moved leftwardfrom the right end while being clicked, but the description of the casein which the first two-screen button 230A is moved rightward from theleft end while being clicked is omitted since the flow of the process ofthe control section 80 controlling the projection is the same in thiscase.

Further, the drag process (step S120) of the two-screen button 230described above is not limited to the configuration of starting from theone-screen display as shown in FIG. 7A, but it is also possible toassume the configuration of starting from the state in which thedual-partitioning display of the first projection screen 210 includingthe UI image 215C and the second projection screen 220 is performed inthe same size.

For example, in the case in which the third two-screen button 230C movesleftward while being clicked, and is then located on the right side ofthe branching position (480) between the second indication line 250D andthe third indication line 250C as shown in FIG. 9A, the control section80 draws the third indication line 250C.

Further, in the case in which the third two-screen button 230C movesleftward while being clicked, and is then located on the left side ofthe branching position (480) between the second indication line 250D andthe third indication line 250C as shown in FIG. 9B, the control section80 draws the second indication line 250D instead of the third indicationline 250C.

Further, in the case in which the third two-screen button 230C furthermoves leftward while being clicked, and is then located on the left sideof the branching position (160) between the first indication line 250Eand the second indication line 250D as shown in FIG. 9C, the controlsection 80 draws the first indication line 250E instead of the secondindication line 250D.

FIG. 5 is a flow chart showing the flow of the process of the releasingprocess (step S140) of the third two-screen button 230C displayed in thecase in which two screens have been displayed.

Firstly, as shown in FIG. 8C, the control section 80 determines (stepS142) whether or not the position where the third two-screen button 230Cis drawn is located on the second indication line 250D.

Here, in the case in which the position where the third two-screenbutton 230C is drawn is located on the second indication line 250D (Yesin the step S142), the control section 80 performs the one-screendisplay as shown in FIG. 8D in the case of moving leftward, or performsthe dual-partitioning display with the third indication line 250C asshown in FIG. 8B in the case of moving rightward (step S146), and thenterminates the process.

On the other hand, in the case in which the position where the thirdtwo-screen button 230C is drawn is not located on the second indicationline 250D (No in the step S142), the control section 80 determines (stepS148) whether or not the position where the third two-screen button 230Cis drawn is located on the (n−2)-th indication line 250.

Here, in the case in which the position where the third two-screenbutton 230C is drawn is located on the (n−2)-th indication line 250 (Yesin the step S148), the control section 80 performs the dual-partitioningdisplay with the (n−3)-th indication line 250 in the case of movingleftward, or performs the dual-partitioning display with the (n−1)-thindication line 250 in the case of moving rightward (step S150), andthen terminates the process.

On the other hand, in the case in which the position where the thirdtwo-screen button 230C is drawn is not located on the (n−2)-thindication line 250 (No in the step S148), the control section 80performs the dual-partitioning display with the (n−2)-th indication line250 in the case of moving leftward, or performs the one-screen displayin the case of moving rightward, and then terminates the process.

Although in the process described hereinabove, the two-screen button 230is clicked and then dragged with the pointing body 70, and is thenreleased at the desired position to thereby draw the guide line 240 andthe indication line 250 and switch between the one-screen display andthe dual-partitioning display, the invention is not limited to thismethod.

For example, in the case in which the dual-partitioning display isperformed with the fourth indication line 250B as shown in FIG. 8A, ifthe control section 80 detects a single click of the right side part ofthe third two-screen button 230C, the control section 80 makes thetransition to the one-screen display in the external input mode as shownin FIG. 7A.

On the other hand, if the control section 80 detects a single click ofthe left side part of the third two-screen button 230C, the controlsection 80 makes the transition to the state in which the screen isdivided into two parts with the third indication line 250C located onthe left side as shown in FIG. 8B.

Similarly, if the control section 80 detects a single click of the leftside part of the third two-screen button 230C in FIG. 8B, the controlsection 80 makes the transition to the state in which the screen isdivided into two parts with the second indication line 250D located onthe left side as shown in FIG. 8C.

Further, if the control section 80 detects a single click of the leftside part of the third two-screen button 230C in FIG. 8C, the controlsection 80 makes the transition to the one-screen display in the WB modeas shown in FIG. 8D.

As described above, the control section 80 moves the boundary line tothe first division position (the indication line 250) adjacent to theindication line 250 indicating the current division position inaccordance with the click of the two-screen button 230.

FIG. 10 is a flowchart showing the flow of a process of determining thesources displayed in the case of performing the dual-partitioningdisplay.

Firstly, the control section 80 determines (step S172) whether or notthe current source displayed in the one-screen display is the desiredsource. Although in the present embodiment, the input source in the WBmode is assumed as the desired source, the invention is not limited tothis example. It is also possible to assume the configuration in whichthe desired source is changed in accordance with the setting of theuser.

Here, the current source displayed in the one-screen display is thedesired source (Yes in the step S172), the control section 80 obtainsthe information related to the source projected before the desiredsource is projected, namely the source projected last time, thenperforms (step S176) the dual-partitioning display with the desiredsource and the source projected last time respectively displayed in theright and left parts of the screen SC, and then terminates the process.It should be noted that it is also possible to store the informationrelated to the source projected last time in the storage section 85.

On the other hand, in the case in which the current source displayed inthe one-screen display is not the desired source (No in the step S172),the control section 80 performs (step S174) the dual-partitioningdisplay with the current source and the desired source respectivelydisplayed in the right and left parts of the screen SC, and thenterminates the process.

In the present embodiment, in the case in which the one-screen displaywith the second projection screen 220 corresponding to the WB mode isselected as shown in FIG. 8D, by clicking the fourth two-screen button230D or the fifth two-screen button 230E and move it in the horizontaldirection, it is possible to perform the dual-partitioning display withthe first projection screen 210 of another source (e.g., the externalinput mode) and the second projection screen 220. In such a case, it ispossible for the projector 10 to set the direction of an area of thesecond projection screen 220 displayed in priority.

FIG. 11 is a diagram for explaining the direction of the area of thesecond projection screen 220 displayed in priority. It is possible forthe operator to set either one of a “left direction,” a “rightdirection,” and “no direction setting” using the direction as an area ofthe second projection screen 220 to be displayed in priority. Theinformation related to the display direction set can also be stored inthe storage section 85.

Firstly, there is described the case in which the “left direction” isset. The screen image SC1 shows the state in which the operator operatesthe pointing body 70 to perform drawing on the second projection screen220 displayed in the one-screen display.

Here, in the case in which the operator clicks the fourth two-screenbutton 230D and moves the button rightward with the pointing body 70,the control section 80 moves the second projection screen 220 rightwardin the state of displaying the left side area of the second projectionscreen 220 in priority, and displays the first projection screen 210 onthe left side in accordance with the size of the space created by themove of the second projection screen 220 as in the screen image SC4.

Further, in the case in which the operator clicks the fifth two-screenbutton 230E and moves the button leftward with the pointing body 70, thecontrol section 80 moves the left end part of the first projectionscreen 210 leftward in the state of displaying the left side area of thesecond projection screen 220 in priority, and displays the firstprojection screen 210 on the right side in accordance with the size ofthe area in which the left end part of the first projection screen 210has moved as in the screen image SC5.

Then, there is described the case in which the “right direction” is set.

Similarly to the “left direction,” in the case in which the operatorclicks the fourth two-screen button 230D and moves the button from thestate of the screen image SC1 rightward with the pointing body 70, thecontrol section 80 moves only the left end part rightward in the stateof displaying the right side area of the second projection screen 220 inpriority, and displays the first projection screen 210 on the left sidein accordance with the size of the area determined by the move of theleft end part of the second projection screen 220 as in the screen imageSC2.

Further, in the case in which the operator clicks the fifth two-screenbutton 230E and moves the button leftward with the pointing body 70, thecontrol section 80 moves the second projection screen 220 leftward inthe state of displaying the right side area of the second projectionscreen 220 in priority, and displays the first projection screen 210 onthe right side in accordance with the size of the space created by themove as in the screen image SC3.

By setting the “right direction” or the “left direction” describedabove, it is useful in the case of making an additional description suchas a memorandum on the right side or the left side of the secondprojection screen 220 by the WB mode.

Further, in the case in which the “no direction setting” is set, whenthe operator clicks the fourth two-screen button 230D and moves thebutton from the state of the screen image SC1 rightward with thepointing body 70, the control section 80 moves only the left end partrightward in the state of displaying the second projection screen 220,and displays the first projection screen 210 by overwriting the firstprojection screen 210 on the left side of the second projection screen220 in accordance with the size of the area determined by the move ofthe left end part of the second projection screen 220 as in the screenimage SC2.

Further, in the case in which the operator clicks the fifth two-screenbutton 230E and moves the button leftward with the pointing body 70, thecontrol section 80 moves only the right end part leftward in the stateof displaying the second projection screen 220, and displays the firstprojection screen 210 by overwriting the first projection screen 210 onthe right side of the second projection screen 220 in accordance withthe size of the area determined by the move of the right end part of thesecond projection screen 220 as in the screen image SC5.

It should be noted that the GUI generation section 50 generates thetwo-screen button 230 based on the data stored in the storage section85. On this occasion, the GUI generation section 50 determines the iconto be displayed in the two-screen button 230 in accordance with thedisplay configuration, namely the one-screen display and thedual-partitioning display. For example, in the case of the one-screendisplay in the WB mode shown in FIG. 8D, the GUI generation section 50adopts an icon corresponding to the input source (e.g., the externalinput mode) newly displayed by moving the two-screen button 230.Further, in the case of the one-screen display in the external inputmode shown in FIG. 7A, the GUI generation section 50 adopts an iconcorresponding to the WB mode newly displayed by moving the two-screenbutton 230.

It should be noted that in the case in which there is a plurality ofselectable input sources, it is also possible that the GUI generationsection 50 generates the two-screen buttons 230 including the iconscorresponding respectively to the input sources, the control section 80arranges the plurality of two-screen buttons 230 thus generated side byside in the second projection screen 220 and displays the plurality oftwo-screen buttons 230 so as to be selected by the pointing body 70.

For example, in the case in which the WB mode (the first source) and thecomputer system (the second source) connected to the input terminalother than the input terminal to which the computer system outputtingthe image signal forming the basis of the image currently displayed inthe first projection screen 210 can be selected as the selectable inputsources in the case of the one-screen display in the external input modeas shown in FIG. 7A, it is also possible to display a sixth two-screenbutton 230F and a seventh two-screen button 230G (a second pointingarea) including an icon corresponding to a computer system (or an inputterminal to which the computer system is connected) other than thecomputer system outputting the image signal forming the basis of theimage currently displayed in the first projection screen 210 in additionto the first two-screen button 230A and the second two-screen button230B (a first pointing area) including the icon corresponding to the WBmode as shown in FIG. 12.

According to the embodiment described hereinabove, the followingadvantages can be obtained.

1. By the operator gripping the pointing body 70 and clicking and movingthe two-screen button 230, which is projected on the screen SC by theprojector 10, using the pointing body 70, the indication line 250indicating the position where the screen SC can be divided is displayedin accordance with the position of the two-screen button thus moved, andby releasing the pointing body 70 therefrom, two-screen display isperformed with the two input sources taking the indication line 250displayed as the division position. Therefore, it is possible for theoperator to easily set the division position for the two-screen displayto thereby perform the two-screen display divided at the desireddivision position.

2. Since the division position for the two-screen display is changedevery time the two-screen button 230 is clicked with the pointing body70, it is possible for the operator to easily change the divisionposition for the two-screen display.

3. In the case in which the projector 10 performs the two-screendisplay, an image by the desired source is projected in one of the twoscreens. Therefore, it is possible for the operator to easily displaythe image by the desired source.

4. It is possible for the operator to set either one of the “leftdirection,” the “right direction,” and the “no direction setting” usingthe direction as an area of the second projection screen 220 to bedisplayed in priority. Therefore, it is possible for the operator toflexibly set the part to be displayed in priority in accordance with thecontent displayed in the second projection screen 220.

Although the invention is hereinabove described based on the embodimentshown in the drawings, the invention is not limited to the presentembodiment, but such modified examples as described below can also beassumed.

1. In the case in which the two-screen button 230 is pointed in thestate of the one-screen display to make the transition to the two-screendisplay, the control section 80 does not perform a signal discriminationprocess on the video signal from the input source currently displayed inthe one-screen display as a main signal, but performs the signaldiscrimination process on the video signal to be added in the two-screendisplay as a sub-signal, and then performs switching. Thus, it ispossible to prevent the picture from the input source displayed in theone-screen display from flickering to degrade the visibility.

2. As the projector 10, there is adopted the short-focus type, which isdisposed immediately above the screen SC, and projects an imageobliquely downward, but the projector is not limited to this typeproviding the interactive function can be realized. For example, along-focus type to be disposed so as to be opposed to the screen SC canalso be adopted.

3. In the case of performing the two-screen display, there is assumedthe configuration of disposing the two screens in the horizontaldirection with respect to the screen SC, but it is possible to assume aconfiguration of disposing the two screens in the vertical direction.Further, a configuration in which the operator designates thearrangement direction can also be assumed. Further, the division is notlimited to the division into two screens, but can also be division intothree or more screens.

4. Although the description is presented citing the configuration, inwhich the three transmissive liquid crystal panels correspondingrespectively to the colors of R, G, and B are used, as an example of thelight modulation device 94, the light modulation device 94 is notlimited to this example. For example, it is also possible to adopt aconfiguration of using three reflective liquid crystal panels, or to usea system having a liquid crystal panel and a color wheel combined witheach other. Alternatively, the light modulation device 94 can beconstituted by a system using three digital mirror devices (DMD), a DMDsystem having a single digital mirror device and a color wheel combinedwith each other, or the like. In the case of using just one liquidcrystal panel or DMD as the light modulation device, the membercorresponding to the combining optical system such as the cross dichroicprism is unnecessary. Further, besides the liquid crystal panel or theDMD, any light modulation device capable of modulating the light emittedby the light source can be adopted.

Further, the device for achieving the method described above can berealized by a single device in some cases, or can also be realized bycombining a plurality of devices with each other, and therefore, avariety of configurations are included.

Further, each of the functional sections of the image processing systemshown in FIG. 2 is for showing the functional configuration realized bythe cooperation of hardware and software, and the specific installationconfiguration is not particularly limited. Therefore, it is notnecessarily required to install the hardware corresponding individuallyto each of the functional sections, but it is obviously possible toadopt a configuration of realizing the functions of the plurality offunctional sections by a single processor executing a program. Further,a part of the function realized by software in the embodiment describedabove can also be realized by hardware, or a part of the functionrealized by hardware can also be realized by software.

What is claimed is:
 1. A display device comprising: an image generationsection adapted to generate a composite image including a first imagebased on a first image signal, a second image based on a second imagesignal, and a boundary line indicating a position to be a boundarybetween the first image and the second image; a display section adaptedto display the composite image generated by the image generation sectionon a display surface; a detection section adapted to detect a positionof a pointing body with respect to the display surface; and a controlsection adapted to make the image generation section generate thecomposite image with the boundary line moved based on the position ofthe pointing body detected by the detection section.